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A pilot study assessed the effects of training in 
self-awareness and self-regulation on the reading comprehension of 
students in a postsecondary occupational training program. Subjects, 
11 students enrolled in a community college technical training 
program in welding; were given training sessions that provided 
practice in metacognitive methods through reciprocal teaching and 
four comprehension monitoring/regulating 

techniques — self-questioniag, summarizing, predicting, and critical 
evaluation of text. During each intervention session, they were 
required to read a 1,000- to 1,500-word passage of expository 
technical prose. At the end of each session, subjects answered 
evaluation questions on a different 500-word passage of similar 
readability in another technical content area. Both a pretest and 
posttest were administered. The pretest mean ranked the group in the 
lowest three percent of collec;e^ freshman, but the posttest mean was 
nearly double the pretest mean, placing the group in the lower 
quartile. Findings suggest that, although substantial growth in 
achievement was indicated, lack of a control group left no basis for 
comparison. Findings also suggest that the average achievement of the 
subjects on the pretest was low enough to 'ndicate that regression to 
the mean contributed substantially to posttest improvement. (A table 
of data and references are appended.) (NKA) 
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The purpose of the study was to assess the effects of 
training in se'if-awaraness and self-regulation on the 
reading comprehension of students in a postsecondary 
occupational training program for welders. Such 
metacogn i t i \ e processes are widely acknowledged as impo»-tant 
factors in comprehension and learning (Armbruster and Brown, 
1984). in problem solving and learning contexts, superior 
performers seem to self monitor their levels o^ success and 
adjust appropriately. 



The notion 


that strateci e 


s for effective learning can 


be 




taught has 


recei ved corsi 


derabl e 


attention from researche 


r s 


during the 


past decade. 


In the c 


ontext of problem sol 


V i n 




( Sternberg 


, 1 977 ) suggest 


s the po 


?.s i b i 1 i ty that i ntel 1 


ec t 


ua 1 


aptitude c 


an be enhanced 


through 


i nstructi on i n the us 


e 0 


f 


metacogni t 


i ve methods . E 


X a m i n a t i 


ons of the effects of 






sel f-regul 


atory strategi e 


s on lea 


rning show the positi 


ve 




influence 


of 1 ear n i ng-to- 


learn st 


rategies on new learn 


i ng 




exper i ence 


s (Bransf ord, 1 


979 ). 









Self-regulation of reading comprehension has been the focus 
of recent studies (Collins and Smith 1982; Palincsar, 1984) 
which have addressed specific aspects of instruction in 
techniques of monitoring and enhancing comprehension. While 
noting that training in such techniques results in 
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worthwhile and reliable improvements, Baker and Brown (1984) 
express chagrin over the lack of research dealing with adult 
metacognition. 



The instructional strategy employed in this study involved 
reciprocal teaching and four comprehension 
monitoring/reg-jlating techniques (self-questioning, 
summarizing, predicting, and critical evaluation of text) 
known to be important in comprehension. Derived from the 
ReQues. Procedure (Manzo, 1969), reciprocal teaching has 
been extended by Collins and Smith (1982). The method was 
recently refined by Palincsar (1984) as a tool for teaching 
comprehension mon i t o r i ng / r eg u 1 a t i ng techniques to remedial 
.^eaders at the junior high school level. 



METHOD 



Subjects 

The study involved eleven 
community college technical t 
The laboratory course in whic 
recuired of the welding curri 



students enrolled in a 
raining program in welding, 
h the study was conducted was 
cu 1 um. 
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Materials 

Duri.,g the intervention phase, training sessions 
provided practice of metacogn i t i ve methods through 
reciprocal teaching, and required subjects to read a 1000 to 
1 500 word passages of expository teclinical prose. 

Passages of approximated 500 words, used at the end of 
each intervention session, and in maintenance and assessment 
phases of the study, were taken from technical '-ources of 
different content, but similar readability to that of the 
materials used in reciprocal teaching sessions. 

A taxonomy (Pearson and Johnson. 1978) was used to 
develop ten questions (four text-explicit, four 
text-implicit, and two sc r i p t- i mp 1 i c i t ) for evaluating 
student comprehension of each passage. Text-explicit 
questions had clearly stated answers in the passage. 
Text-implicit questions required integration of information 
from different parts of the passage. Answers to 
script-implicit questions relied on reader ability to apply 
prior knowledge and experience to the passage. 

Pre- and posttests involved administration of alternate 
forms of the Cooperative English Test Form 2, Reading 
Comprehen s i on . 
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Procedure 

The study employed a multiple-baseline procedure. Each 
subject experienced four conditions: baseline, intervention, 
maintenance, and assessment. A standardized test of reading 
comprehension was administered just before baseline and 
immediately after assessment phases. 



Pr i 


0 r 


to i n i t i ati on 


of the study, three one 


-hour 


tr ai ni n 


g 


sessions were 


conducted by the princip 


al 


i n vesti 


ga 


tor for the co 


urse instructor and co-i 


nvesti gator, 


each of 


w 


hom had read a 


nd discussed reports of 


studies 


i nvol vi 


ng 


rec i proca 1 te 


aching and metacognitive 


methods . 


Fol 1 owi 


ng 


ci review of f 


our comprehensi on 




se 1 f -mo 


n i 


tori ng/enhanci 


ng activities--self-ques 


t i 0 n i n g , 


s umma r i 


z i 


ng , pred i ct i ng 


, critical evaluation of 


text — the 



reciprocal teaching procedure was demonstrated. The four 
part metacognitive procedure was then modeled and practiced 
via reciprocal teaching. 

iiseline activities involved three 20 minute sessions in 
wfiich students were instructed to t^ead assessment passages 
carefully. Comprehension questions were answered in writing 
after each reading. 
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illiHlXmll£Il activities involved instruction in the use 
of the four s e 1 f - r eg u 1 a t ed comprehension activities during 
twenty minute sessions of three consecutive class meetings. 
In order to minimize the class time devoted to the study, 
two groups were formed withinthe class. Each group was led 
by a faculty instructor who began by modeling the four 
comprehension self-monitoring/regulating techniques, then 
passing the teacher's role along to student members of the 
group. In the final minutes of each intervention session, 
assessment passages were read and answers to comprehension 
questions written. 



activities were conducted over three 
sessions, beginning immediately after intervention sessions 
terminated. Maintenance sessions were similar in format to 
baseline except that comprehension questions were not 
presented . 

^11 tests were conducted five weeks after the 

maintenance sessions were concluded. During a single 
one-hour session, three assessment exercises wer? done in 
order to evaluate the effects of training and practice in 
the self-regulation of reading comprehension. 
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During periods of one hour each, a pre- and 
postexperimental administration of the Cooperative English 
Test, Form 2B and 2C, reading subtest was conducted in order 
to provide a comparico"^ with experimental measures of 
comprehension. Pretesting was accomplished just prior to 
the initiation of baseline activities. The posttest was 
given the week after assessment activities were completed. 



RESULTS 

Statistical analysis of subject performance on six 
measures of reading c ompr eh e n s i on--b a se 1 i ne , intervention, 
assessment, year-end, and standardized pre- and 
posttes ts--was done through simple T-tests, Table One shows 
results of the comparisons. 



Insert Table One about here 



Baseline and intervention results were not significantly 
different T = -.1424, sig = .4425. Assessment means were 
negatively correlated with both baseline and assessment 



ERIC ° 



Comprehension Training 7 



mean s , T = -4.6915, 
comprehension measu 
d i f f erences wi th ba 
i ntervent i on T = 1 . 



sig = . 001 . Comp 
res showed absence 
sel i ne, T = . 441 1 , 

0032, sig = .1782 



ari sons of year-end 
of significant 
sig . 3379 , and 



Results of pre- and postexper i men tal comparisons of 
total reading raw score means of the Cooperative English 
Test showed significant gains. The pretest mean ranked the 
group in the lowest three percent of college freshmen. 
Posttest mean was nearly double the pretest mean, placing 
the group in the lower quartile. This questionable increase 
is discussed below. 



DISCUSSION 

The time and effort spent on this pilot study did not 
produce enlightening results. Negative correlations between 
investigator designed pre- and po s t ex pe r i me n t a 1 measures of 
comprehension were due, at least in part, to the fact that 
assessment measures were more difficult than baseline and 
intervention measures. An unknown which may have affected 
this result was the amount of reading done by the subjects 
during the interval between intervention and follow-up 
measures. Another possib^ influential factor was the 
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amount of ac t u 


a 1 app 


1 i c a t i 0 n or t h 


e met 


acogni ti ve 


re 


ad i 


ng 


techniques dur 


i ng t h 


e period. In 


both 


cases, abs 


enc 


e 0 


f 


practice would 


act a 


s a detriment 


to ma 


i n tenance 


of 


ski 


1 1 s 


Unfortunately, 


recor 


ds of readi ng 


time 


and use of 


re 


ad i 


ng 


techniques wer 


e not 


kep t . 













Two 


f ac 


tors 


rendered C 


oope r a t i 


ve English r 


e ad i n g 


comprehen s i 


on te 


s t compar i 


sons u n i 


nterpretabl e 


First, 


though s 


ubs 


tan ti 


al growth 


in ach i e 


vemen t was i 


nd i cated , 


absence 


of 


a con 


tro 1 group 


left no 


basis for c 


ompar i son . 


Secor J , 


the 


aver 


age ach i e v 


ement of 


the subject 


s on the 


pretest 


was 


1 ow 


enough to 


suggest 


that regress 


ion to the 


mean con 


tri 


bu ted 


substant i 


ally to 


pos ttest -i mp 


rovement . 


Sti 1 


1 , 


the p 


i 1 0 t was u 


sef u 1 an 


d the pi tf al 


1 s i dent i f 



will be addressed in the follow-up study. First, greater 
c?.re has been taken in establishing the difficulty of 
passages and comprehensTon questions. Here, three 
readability measures will be used: the Fry Readability 
Graph, Clark's (1981) phrase analysis (PHAN) system, and 
expert judgement. Second, records of subject reading time 
and use of metacogn i t i ve methods beyond the experimental 
activities will be kept. Third, t' ^ multiple baseline 
across groups design will be used. If technical program 
enrollment is great enough, a control group will be used as 
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insurance against historical difficulties. Fourth, 
contingent upon control group availability, the Nelson-Denny 
Reading Test will be used as the standardized measure of 
reading comprehension; its level of difficulty is more 
appropriate for the abilities of the study subjects. 



er|c 
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Table One 
Means, Standard Deviations 
for Comprehension Measures 



in-line intervention Assessment Year-End Pie_Coo£_^ Poii._Coo£_^ 
19.5 (4.2) 18.9 (2.82) 13.9 (4.2) 20.2 (3.28) 34.7 (10.6) 66.6 (10.4) 
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